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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . This communication is responsive to Amendment, filed 12/04/2009 . 

2. The allowed claim(s) is/are 18-23 . 

3. ^ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a) ^All b)DSome* c) □ None of the: 

1. ^ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1 ) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1. 84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1 . ^ Notice of References Cited (PTO-892) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 

3. S Information Disclosure Statements (PTO/SB/08), 

Paper No./Mail Date 10/05/09 

4. □ Examiner's Comment Regarding Requirement for Deposit 

of Biological Material 



5. □ Notice of Informal Patent Application 

6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

7. □ Examiner's Amendment/Comment 

8. ^ Examiner's Statement of Reasons for Allowance 

9. □ Other . 



/Amelia Rutledge/ 

Primary Examiner, Art Unit 2176 
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DETAILED ACTION 

1 . This action is responsive to the following communications: Amendment, filed 
12/04/2009; Information Disclosure Statement, filed 10/05/2009. 

2. Claims 18-23 are allowed. Claims 18 and 20-23 are independent claims. 

REASONS FOR ALLOWANCE 

The following is an examiner's statement of reasons for allowance: 

The prior art, U.S. Patent No. 4,680,647 to Moriyama, teaches a method for 
recording a video format signal for still picture and audio (Figs. 22; 31; 33; col. 6, 1. 1- 
45). Moriyama teaches a recording medium which is a video disc, as well as other 
formats (col. 49, 1. 14-58). Moriyama teaches adding several types of audio to a still 
image recording, in order to add selection of recordings of audio information (col. 6, 1. 9- 
51). Moriyama teaches successive reproduction for audio data and still image mode 
(col. 5, 1. 5-68; col. 43, 1. 10-67), or reproduction in response to a control signal supplied 
from an external source (col. 39, 1. 46-col. 40, 1. 39). 

U.S. Patent No. 6,915,012 B2 to Osborne et al., teaches a method of embedding 
random data in a JPEG file, i.e., a still picture (col. 1, 1. 46-col. 2, 1. 36; col. 3, 1. 5-col. 4, 
I. 3). Osborne explicitly teaches setting a start time of an audio file associated with the 
picture, and a loop count, which will determine how many times the audio will loop in 
conjunction with the image; if set to zero, the audio will loop continuously (Table 3, 
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"Loop Count"). Osborne teaches that multiple images may be stored and played at 
specific times to coincide with the audio playback (col. 1 3, 1. 1 -21 ). 

Neither Moriyama nor Osborne discloses the following newly claimed limitations 
of independent claim 18: 

.... recorded object data, the object data being a multiplex of a first stream 
including still picture information and a second stream including audio information by a 
unit of packet; and recorded reproduction control information, the reproduction control 
information comprising: 

i) first reproduction sequence information which designates a reproduction 
sequence of the first stream by a first unit and which includes time information indicating 
a reproduction start timing of the first unit; 

ii) reproduction time information which indicates whether each still picture of the 
still picture information of the first stream is a finite value or an infinite value, and which 
indicates a reproduction time of the still picture whose reproduction time is the finite 
value; 

Hi) first type information which indicates a type of the first unit 

iv) first storage position information which indicates a storage position of the 
object data designated by the first unit; 

v) second reproduction sequence information which designates a reproduction 
sequence of the second stream, and which includes audio repeat information indicating 
whether or not the audio information of the second stream is to be repeatedly 
reproduced; 
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vi) second type information which indicates a type of the second stream; ... 

Independent claims 20-23 recite similar limitations to the above limitations of 
independent claim 18. 

Neither Moriyama nor Osborne disclose ...multiplex of a first stream including still 
picture information and a second stream including audio information by a unit of 
packet...; (see Remarks, p. 13-15), in combination with the limitations: 

ii) reproduction time information which indicates whether each still picture of the 
still picture information of the first stream is a finite value or an infinite value, and which 
indicates a reproduction time of the still picture whose reproduction time is the finite 
value; 

and 

v) second reproduction sequence information which designates a reproduction 
sequence of the second stream, and which includes audio repeat information indicating 
whether or not the audio information of the second stream is to be repeatedly 
reproduced; 

It would not have been obvious to one of ordinary skill in the art at the time of the 
invention to have combined Moriyama and Osborne to arrive at the instant invention, 
because the above claimed features of the instant invention are not disclosed in the 
prior art of record. 
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A search of the prior art did not produce any prior art disclosing the combination 
of limitations claimed in independent claims 18 and 20-23, in particular, the steps of 
multiplexing the stream of still picture information and the stream of audio information, 
combined with designating the reproduction time of the still picture as a finite or infinite 
value, and audio repeat information indicating whether or not the audio information of 
the second stream is to be repeatedly reproduced. 

Independent claims 18 and 20-23 are defined in the specification as being 
directed to statutory categories of invention under 35 U.S.C. 101 . The information 
record medium of claim 18 is limited to a statutory medium in the specification, p. 14, 
which defines the medium as an optical disk. The apparatus claimed in claims 20 and 

22 is limited to hardware in the specification, p. 27-29. The methods of claims 21 and 

23 are also statutory under 101 . 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 
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Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Christel, et al., "Information Visualization Within a Digital Video Library", Journal of 
Intelligent Information Systems, Vol. 11, Issue 3, Nov/Dec 1998, p. 235-257. 

Furht, "Multimedia systems: an overview", Multimedia, IEEE, Vol. 1, Issue 1, Spring 
1994, p. 47-59. 

Meyer, et al., "A Taxonomy on Multimedia Synchronization", copyright 1993, IEEE, p. 
97-103. 

Seoetal. U.S. Pub. No. 2004/0109676 A1 published June 2004 

Jung et al. U.S. Pub. No. 2004/0252978 A1 published December 2004 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to AMELIA RUTLEDGE whose telephone number is 
(571)272-7508. The examiner can normally be reached on Monday - Friday 9:30 - 6:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Doug Hutton can be reached on 571-272-4137. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 



Application/Control Number: 1 0/561 ,1 84 Page 7 

Art Unit: 2176 

Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Amelia Rutledge/ 

Primary Examiner, Art Unit 2176 



